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Our  research  supported  by  ARO/SDI  contract  DAAL03-80-K-0110,  has  had  a 
number  of  successes  in  the  problems  of  Computer  (Robot)  Vision  and  Image  Pro¬ 
cessing.  In  particular,  we  have  developed:  I)  A  parallel  multilevel,  multiresolu¬ 
tion  algorithm  for  Image  Processing  and  “low-level”  Robot  vision  tasks,  II)  A 
Bayesian/Geometric  framework  for  3-D  shape  estimation  from  2-D  images,  appro¬ 
priate  for  object  recognition  and  other  Robot  tasks,  III)  A  procedure  for  rotation 
and  scale  invariant  representation  (coding)  and  recognition  of  textures;  a  computa¬ 
tionally  efficient  algorithm  for  estimating  Markov  Random  Fields,  and  IV)  We  have 
obtained  mathematical  results  concerning  convergence  and  speed  of  convergence 
of  computational  algorithms  such  as  the  annealing  algorithms,  and  have  studied 
mathematically  the  consistency  and  asymptotic  normality  of  Maximum  Likelihood 
estimators  for  Gibbs  distribution^. 

Below  we  provide  a  brief  description  of  the  above  contributions: 

I)  In  our  paper  entitled  “A  Renormalization  Group  Approach  to  Image  Process¬ 
ing  Problems”,  IEEE  PAMI- 11(1989)  164-180  (attached  to  this  report);  we  have 
introduced  a  multiresolution,  multilevel  procedure  for  studying  Image  processing 
(segmentation,  noise  removing,  texture  and  motion  analysis,  etc.),  and  Computer 
Vision  tasks.  The  method  combines  Renormalization  Group  Ideas,  Monte-Carlo 
type  algorithms,  and  is  implementable  on  parallel  architectures.  The  algorithm 
should  be  useful  in  other  problems  such  as  tracking  military  objects,  analysis  of 
satellite  data,  and  speech  recognition.  The  method  has  been  tested  in  many  exper¬ 
iments,  and  the  results  have  been  remarkable. 

II)  The  real-time  acquisition  of  reliable  and  complete  3-D  features  from  2-D 
images,  is  a  key  step  to  object  recognition  and  Robot  manipulation  tasks.  It 
has  been  the  central  point  in  our  studies  of  3-D  Vision.  In  a  paper  entitled  “A 
Bavesian/Geometric  Framework  for  Reconstruction  of  3-D  Shapes  for  Robot  Vi¬ 
sion”,  High  Speed  Computing  II,  SPIE  Vol.  1058  (1989)  86-93  (and  in  Ph.D.  Thesis 
by  my  student  Jose  Torreao,  1989),  we  have  developed  and  experimentally  tested 
a  Bayesian  framework  for  examining  3-D  features  from  two  noisy  images  acquired 
by  a  single  camera,  but  with  two  light  sources  of  different  origins.  The  key  to  this 
method  is  appropriate  prior  distributions  which  describe  Random  Surfaces.  These 
distributions  (inspired  by  Statistical  Mechanics  models)  quantify  our  intuitive  ex¬ 
pectations  about  3-D  shapes,  but  do  not  make  any  particular  assumptions  about 
the  surfaces  (i.e.  whether  they  are  planar,  spherical,  quatric,  etc.).  The  method  has 


provided  an  efficient  and  accurate  solution  to  some  traditional  problems  of  Shape- 
from- Shading,  Shape-from-Texture,  and  partial  classification  of  zero-crossings.  The 
framework  is  suitable  for  sensor  fusion  (e.g.  laser  radar  data,  infrared  data,  and 
visible  light  data). 

III)  Rotations  and  scale  invariant  recognition  of  objects  is  one  of  the  unresolved 
and  important  problems  in  Robot  vision.  Our  multiresolution,  multilevel  method 
(part  I)  aims  at  this  problem.  Furthermore,  in  a  recent  paper  (attached  in  this  re¬ 
port)  entitled  “A  Variational  Method  for  Estimating  the  Parameters  of  MRF  from 
Complete  or  Incomplete  Data”  (and  in  Ph.D.  Thesis  by  my  student  Murilo  Almeida, 
(1989),  we  have  introduced  a  procedure  for  studying  representation  (coding)  and 
recognition  of  textures  in  a  scale  and  orientation  invariant  way.  The  procedure  is 
based  on  a  class  of  models  which  are  defined  at  all  levels  of  resolution  and  scale. 
These  models  contain  a  number  of  parameters  which  need  to  be  estimated  from  the 
data  (“learning”  stage).  This  motivated  us  to  develop  a  fast  algorithm  (tne  Vari¬ 
ational  Method )  for  estimating  these  parameters.  The  algorithm  is  more  efficient 
than,  and  as  accurate  as,  its  best  competitors:  the  Maximum  Pseudo-Likelihood 
method,  and  the  EM  algorithm.  The  algorithm  is  general  and  suitable  for  Neural 
Network  problems,  Speech  Recognition,  and  Tomography. 

IV)  The  problems  of  Image  Processing  and  Computer  Vision  have  led  to  a  num¬ 
ber  of  interesting  mathematical  questions  concerning  the  theoretical  behavior  of 
computational  and  inference  algorithms.  In  the  past,  we  have  studied  convergence 
and  speed  of  convergence  for  the  annealing  and  Langeving  algorithms.  We  have  also 
proven  that  our  multiresolution  algorithm  (the  Renormalization  Group  algorithm) 
converges  to  the  true  solution,  and  have  analyzed  its  computational  complexity. 
More  recently  (past  two  years),  in  a  series  of  papers  (some  of  which  are  attached  to 
this  report),  we  have  settled  in  a  satisfactory  way  the  consistency  and  asymptotic 
behavior  (as  the  size  of  the  problems  become  larger  and  larger,  of  Maximum  Like¬ 
lihood  estimations  for  Gibbs  distributions.  These  studies  involve  Large  Deviation 
techniques,  and  have  given  rise  to  an  interesting  interplay  between  Statistics  and 
the  phenomena  of  Phase  Transitions  in  Statistical  Mechanics. 
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